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Analogs of Cramer's rule for the least squares 
solutions of some matrix equations. 

Ivan Kyrchei * 

Abstract 

The least squares solutions with the minimum norm of the matrix 
equations AX = B, XA = B and AXB = D are considered in 
this paper. We use the determinantal representations of the Moore - 
Penrose inverse obtained earlier by the author and get analogs of the 
Cramer rule for the least squares solutions of these matrix equations. 
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^ . tion, Cramer rule 
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g : 1 Introduction 

In this paper we shall adopt the following notation. Let C*"^" be the set of 
m by n matrices with complex entries, C™^" be a subset of C"^^" in which 
^ I any matrix has rank r, be the identity matrix of order m, and ||.|| be the 

H ' Frobenius norm of a matrix. 

Denote by a,j and a^, the jth column and the ith row of A G C"^^", 
respectively. Then a*- and a* denote the jth column and the zth row of a 
Hermitian adjoint matrix A* as well. Let A,j (b) denote the matrix obtained 
from A by replacing its jth column with the vector b, and by Aj. (b) denote 
the matrix obtained from A by replacing its ith row with b. 

Let a := {ai, . . . , ak} C {1, . . . , m} and /3 := . . . , C {1, . . . , 
be subsets of the order 1 < A; < min{m,n}. Then |A^| denotes the minor 
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of A determined by the rows indexed by a and the columns indexed by 
p. Clearly, |A^| be a principal minor determined by the rows and columns 
indexed by a. For 1 < k < n, denote by 

Lk,n := {a : a = {ai, . . . , ak) , 1 < ai < . . . < ak < n} 

the collection of strictly increasing sequences of k integers chosen from the 
set {1, . . . , n}. For fixed i E a and j G /3, let 

Ir,m{i} :={«:«€ U^m^i e a}, Jr,n{j} ■■= {(3 : /3 e Lr,n,j ^ (3} ■ 

Matrix equation is one of the important study fields of linear algebra. 
Linear matrix equations, such as 

AX = B, (1) 
XB = D, (2) 

and 

AXB = D, (3) 

play an important role in linear system theory therefore a large number of 
papers have presented several methods for solving these matrix equations 
[D 121 El m [5] . In [6] , Khatri and Mitra studied the Hermitian solutions to 
the matrix equations ([1]) and (jSj) over the complex field and the system of 
the equations ([1]) and ([2]). Wang, in [71 [8], and Li and Wu, in [9] studied 
the bisymmetric, symmetric and skew-antisymmetric least squares solution 
to this system over the quaternion skew field. Extreme ranks of real matrices 
in least squares solution of the equation ([3|) was investigated in [10] over the 
complex field and in [11] over the quaternion skew field. 

As we know, the Cramer rule gives an explicit expression for the solution 
of nonsingular linear equations. In [12], Robinson gave its elegant proof 
over the complex field which aroused great interest in finding determinantal 
formulas as analogs of the Cramer rule for the matrix equations [131 El 113 
Hg im mi [201 [221 [231 121]. The Cramer rule for solutions of the restricted 
matrix equations ([T|), (|2|) and ([3|) was established in [2T] . 

In this paper, we use the results of [IH] to obtain the Cramer rule for 
least squares solutions of the matrix equations ([I|), (|2|) and dHj) without any 
restriction. The paper is organized as follows. We start with some basic 
concepts and results about determinantal representations of the Moore - 
Penrose inverse in Section 2. In Section 3, we derive some generalized Cramer 
rules for the matrix equations ([1]), and (|3|). In Section 4, we show a 
numerical example to illustrate the main result. 



2 



2 Determinantal representations of the Moore 
- Penrose inverse 



Definition 2.1 //AG C"^", then the matrix is called the Moore - Pen- 
rose inverse of A if it satisfies the equations: 1 ) (AA"*")* = AA+; 2) (A+A)* = 
A+A; 5;AA+A = A; ^;A+AA+ = A+. 

It is well known the following proposition. 

Lemma 2.1 For an arbitrary A G C"^" there exists a unique Moore - Pen- 
rose inverse A"*". 

Lemma 2.2 J2^ If A e C™^", then 

A+ = liniA* (AA* + AI)~^ = lim (A*A + AI)"^ A*, 

A->0 A-i-O 

where A G M+, and M_|_ is a set of the real positive numbers. 

Corollary 2.1 If A E C™^", then the following statements are true, 
i) //rank A = n, then A+ = (A*A)"^ A* . 
a) //rank A = m, then A+ = A* (AA*)"^ . 
Hi) //rank A = n = m, then A+ = A^-*^ . 

Theorem 2.1 ITB] If A E C^^" and r < min{m,n} , then the Moore- 
Penrose inverse A'^ = [afj) G C"^™' possess the following determinantal 
representations: 



E ((A*A),^(a*.)) 



13 
13 




l3eJr,n{i} 



(4) 



E (A*A) 



or 



E |((AA*),,(a*)) 



a 



a 




aelr,m{j} 



(5) 



E |(AA*) 
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Remark 2.1 //rank A = n, then by Corollary = (A* A) ^A*. 

Therefore, we get the following representation o/ A+; 

^ /det(A*A).i(a^) ... det(A*A). i (a*J \ 
det(A*A) \^det(A*A).„(a*i) ... det(A*A).„ (a*„)./ 
// rank A = n < m, then by Theorem \2.1\ for A"*" we have as well. 

Remark 2.2 //rank A = m, then by Corollary \2J\ = A* (AA*)"\ 
Hence, we obtain the following representation of A'^ : 

^ /det(AA*)i.(a* ) ... det(AA*)„. (a^X 
A+ = ... ... ... (7) 

^^^^^^*^\dei{AA*),,{s.l) ... det(AA%.(a:,)/ 

//rank A = m < n, then by Theorem \2.1\ for A+ we also have 

3 Cramer's rule of the least squares solution 
of some matrix equation 

Definition 3.1 Consider a matrix equation (Qjj, where A e C^^^jB G 
(^mxs given, X G C"^'* is unknown. Suppose 

Si = {X|X G C"^", ||AX - B|| = min}. 

Then matrices X G C"^'^ such that X G are called least squares solutions 
of the matrix equation (Qp. If ^ls = minxGSi||X||, then X^g is called the 
least squares solution of (Qp with minimum norm. 

If the equation ([1]) has no precision solutions, then X^^ is its maximum 
approximate solution. 

The following important theorem is well-known. 

Theorem 3.1 (ITS^ ) The least squares solutions of (QP are 

X = A+B + (I„-A+A)C, 

in which C G C"'^'* is an arbitrary matrix and the minimum norm solution 
IS y.LS = A+B. 
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We denote A*B =: B = (%) G C"^^ 

Theorem 3.2 (i) //rank A = n, then for the least squares solution^LS 



{xij) G C"^'' for all i = l,n, j = 1, s we have 

det(A*A).i (h,j 



det(A*A) 

where h j is the jth column of B for all j = l,s. 



(8) 



(ii) //rank A = r < m < n, then for all i = l,n, j = 1, s we have 



E |((A*A).,(b 



X. 



^GJr,n{i} 



E (A*A) 



(9) 



Proo/ i) If rank A = ri, then by Corollary lO A+ = (A* A) ^A*. By 
multiplying A+B = (A*A)~^ A*B = (A*A)~^ B, we obtain for aU i = 1, n, 

J = M 



Xi 



1 

det(A*A)^^'^^ 



kj, 



where Lij is a ijth cofactor of (A* A) for all i,j = l,n. Denoting the jth 
column of B by b.j, it follows ([8]). 

ii) If rank A = r < m < n, then by Theorem 12. II we can represent the matrix 
A'*' by (jl]). Therefore, we obtain for all i = l,n, j = 1, s 



Xi 



„ E ((A*A).,(a*J)g 

l3eJr,n{i} 



tt Z (A*A) 



■6, 



kj 



E (A*A)^ 
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Since E^*fc^fcj 

k 



( E<kbk3 \ 

k 

(^*2kbkj 

k 



. YjKik^kj 



b.j, then it follows 



Definition 3.2 Consider a matrix equation 

XA = B, (10) 

where A G C^^^jB G C^" are given, X G C'^^'" is unknown. Suppose 

S2 = {X| X G e^™, ||XA - B|| = min}. 

Then matrices X G C*^™ S'uc/i ^/iai X G 5*2 are called least squares solutions 
of the matrix equation fTd\) . //X^s = minxeS2 11-^11 > ^^^^^ ^ls is called the 
least squares solution of fTd\} with minimum norm. 



The following theorem can be obtained by analogy to Theorem 13.11 

Theorem 3.3 The least squares solutions of l[Td\) are 

X = BA+ + C(I™- AA+), 

in which C G C*^™ zs an arbitrary matrix and the minimum norm solution 
%s l^LS = BA+. 

We denote BA* =: B = (hij) G C"^*". 

Theorem 3.4 (i) //rank A = m, then for the least squares solution = 
(xij) G C^^™ for all i = 1, s, j = l,m we have 

det(AA*)j. (b,.) 



X. 



det(AA*) 

where hi is the ith row o/B for all i = l,s. 



Ill 



(a) //rank A = r < n < m, then for all i = 1, s, j = l,m we have 

E ((AA*)^,(b,y 

a€lr,m{l} 



E l(AA*)-| 

m 



(12) 
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Proof, i) If rank A = m, then by Corollary A+ = A* (AA*) ^. By 
multiplying BA+ = BA* (AA* 



BfAA* 



, we obtain for all i = 1, s, 



j = l,m, 



Xi 



^ m 

det(AA*)|J^^^^^'=' 



where Rij is a ijth cofactor of (AA*) for all i,j = l,m. Denoting the ith 
row of B by b,. , it follows (ITT]) . 

ii) If rank A = r < n < m, then by Theorem 12. II we can represent the matrix 
A+ by ([5]). Therefore, for alH = 1, s, j = 1, m we obtain 



Xi 



E 



;AA*)^,(aL 



k=l 



k=l 



E l(AA*) 



aelr. 



ELAk E . |((AA*)^,(a; 



a 

^k.J I a 



Since for alH = 1 , s 



E l(AA*)2| 



E bik^li E hkO'l2 



E ^ifeOfcm 



k 

then it follows ■ 

Definition 3.3 Consider a matrix equation where A G CJ?]^^",B G 
C^2^'^, D G C™^'' are given, X G C"^^ unknown. Suppose 

S3 = {X| X G C"^P, II AXB - D|| = min}. 

Then matrices X G C"^^ swc/i that X G 6*3 are called least squares solutions 
of the matrix equation If 'Kls = niinxeSallXjl, then X.ls is called the 
least squares solution of ^ with minimum norm. 

The following important theorem is well-known. 

Theorem 3.5 (J2^]) The least squares solutions of ^ are 

X = A+DB+ + (I„ - A+A)V + W(Ip - BB+), 

in which {V,W} C C"^^ are arbitrary quaternion matrices and the least 
squares solution with minimum norm is = A+DB"*". 



7 



We denote D = A*DB*. 

Theorem 3.6 (i) If rank A = n and rankB = p, then for the least 
squares solution X^^ = (xij) G C"^^ of ^ we have for all i = l,n, 
J = hp, 

det((A*A)., (d^)) 



X. 



or 



where 



det(A*A) ■ det(BB*)' 

_ det((BB*),. (d-^)) 
det(A*A) ■det(BB*)' 

det((BB*),. fdi. det ((BB*),. ( d. 



det ((A* A)., (d.i)) , . . . ,det ((A* A)., (d.^ 



(13) 
(14) 

(15) 
(16) 



are respectively the column-vector and the row-vector, dj, is the ith row 
o/D for all i = l,n, and d j is the jth column o/D for all j = l,p. 

(a) //rank A = ri < m and rankB = r2 < p, then for the least squares 
solution X.LS = {xij) G C^^^ of ^ we have 



E (A*A) .^(dB.) ^ 

/3G Jrj, n{«} 



,n 



E (A*A)^ E l(BB*)^| 



(17) 



or 



E (BB*)^,(d^) 



E (A*A)^ E l(BB*) 



a€lr. 



(18) 



where 



■ J 



|(BB*)^,(di.) ^|,..., |(BB*),.(d..) ^ 



(19) 
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J2 |(A*A).,(d.i) ^|,..., Yl |(A*A).,(d., 



13 

Pi P 



20) 



are the column-vector and the row-vector, respectively. 



(in) //rank A = n and rankB = r2 < p, then for the least squares solution 
= {xij) G C"^P of ^ we have 



det((A*A)., (dg)) 
det(A*A) I(BB*; 



(21) 



or 



E (BB*)^,(d,^) 

ae/r2,p{i} 

det(A*A) E l(BB^ 



'a I 



where d^- zs / fT^) anc? d^ zs H 



(22) 



(an) //rank A = ri < m and rankB = p, then for the least squares solution 
= (xij) G C"^P 0/ ^ we have 



det((BB*),. (d^)) 



E 



:a*a)^ 



det(BB* 



(23) 



or 



E (A*A),,(dB.)^ 

/9GJri,n{«} 

E (A*A)^ det(BB*) 



w/iere d^- is [W\) and d^ zs [2U\) 



(24) 



Proof, i) If rank A = and rankB = p, then by Corollary 12.11 A^ 
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(A*A)"^ A* and B+ = B* (BB*)"\ Therefore, we obtain 



X 



X 



/ 2^11 Xi2 

( dyx dl2 

d21 d22 

\dnl dn2 



LS 



A*A)^A*DB* (BB 



X2p 



d\m \ 
d2m 

dnm j 



1 



/ rA rA 

rA rA 

^12 ^22 



dct(A*A) 



1 



V-^^ L2n 

( -R n -R 21 

dB dB 

'^\2 ^22 



dct(BB*) 



\R% R 



2p 



^n2 

tA I 

nn / 

^p2 

R^pl 



where dij is zjth entry of the matrix D, Lf^- is the ijth. cofactor of (A* A) for 



all i^j = l,n and R~j is the zjth cofactor of (BB*) for all i^j = l,p. This 
implies 



Xi 



k=l 



P _ 



s=l 



■js 



det(A*A) ■ det(BB*)' 



(25) 



for all i = l,n, j = l,p. We obtain the sum in parentheses and denote it as 
follows 

p 

Y^dksRfs = det(BB*),, (d^,) := df^, 



where d^, is the kth row- vector of D for all /c = l,n. Suppose d 



(^dfj,...,d^j)'^ is the column-vector for all j = l,p. Reducing the sum 

n 

Yl ^ki'^fjj obtain an analog of Cramer's rule for (|3]) by ( IT3|) . 

k=l 

Interchanging the order of summation in (125 p . we have 



E(ELtdks)R% 

s=l \k=l ' 



det(A*A) ■ det(BB*)' 
We obtain the sum in parentheses and denote it as follows 



n 

Y^Ltdks = det(A*A)., (d.,) =: df 



A 

si 



k=l 
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where is the sth column- vector of D for all s = l,p. Suppose df^ :- 



{d^i, . . . , df^p) is the row- vector for alH = 1, n. Reducing the sum df^s^fsy 

s=l 

we obtain another analog of Cramer's rule for the least squares solutions of 

ii) If A G C™''", B e CP^'^ and n < n, ra < p, then by Theorem O the 
Moore-Penrose inverses A"*" = (a^) G C"^™ and B"*" = (6^) G C^^^ possess 
the following determinantal representations respectively, 



E (A* A) ,, (a*,.) 

_|_ /3GJri,n{«} 



E (A*A) 



6,^ 



E 

ae/r2,p{i} 



:BB*),.(b*)2| 



E l(BB*)2| 



(26) 



Since by Theorem 13.51 Xr ^ = A+DB"^, then an entry of 'Kls = {^ij) is 



Xi 



(27) 



s=l \A:=1 



Denote by d.^ the sth column of A*D =: D = (dij) G C"^^ for all s = l,q. 
It follows from E ^*k^ks = d.^ that 



E 

/3e Jr^, n{«} 



k=l 



k=l 



E 



:a*a) 



■ dks 



E E (A*A).,(a*J^ 

/9eJri,n{i} k = l 



■ dks E 



'A* A) 



E (A*A)^ 



E (A*A)^ 



(28) 



Suppose and e ^ are respectively the unit row- vector and the unit column- 
vector whose components are 0, except the sth components, which are 1. 
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Substituting ([2H]) and in ([27]), we obtain 



Xi 



E 

s=l 



l3eJri,n{i} 



E (A*A)Jd 



E i(BB*),.(b:. 

«e/r2,p{j} 



E (A* A) I 



E I(BB*)S| 



Since 



d. s = ^ e. idis, b* = ^ 6*tet. , ^ = du, 



(29) 



s=l 



then we have 



q p n 

EEE E (A*A) ,(e,,)?d,,6:, E l(BB*),.(e, 

« = l<=l^ = l/3eJri,n{j} aG/r2,p{i} 



E (A* A) 2 E l(BB* 



p n 



EE E (A*A).,(e.,)g rf,, E |(BB*),.(e,)-| 

t=l i = l /3eJri,n{«} aG/r2,p{i} 



1 5^ 



E (A*A)^ E l(BB*)2l 



(30) 



a€-fr2,p 



Denote by 



n 

E |(A*A).,(d,)^|=5^ 5^ |(A*A).,(e.,) 



dit 



the tth component of a row-vector = {df^, d^) for all t = Substi- 
tuting it in (130|) . we have 



Ec^^ E l(BB*),.(e 

t=i ae/r2,p{i} 



, n 



E (A*A)^ E l(BB*)-| 



a£-fr2,p 



Since E c^it ^t. = then it follows ( !T8|) . 
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If we denote by 



t=l aelr2,p{j} 



fBB* 



(31) 



the Ith component of a column- vector d^- = ((if-, (i^) for all / = 1, n and 



substitute it in fl30ll. we obtain 



Xi 



E E (A*A).,(e.,)? 

i = l/3eJri,n{i} 

E (A*A)^ E l(BB*)g| 



/9GJri, 



'■2.P 



Since E e./c/g = d^., then it follows (JIZ]). 



iii) If A G c;:^^'^, B e 



'r2 



and ri = ?7,, r2 < then by Theorem 12.11 
and Remark 12.11 the Moore- Penrose inverses A+ = (a^) G C"^'" and B+ = 
(6^) G C^^^ possess the following determinantal representations respectively, 



det (A* A) , (a*.) 
det (A* A) ' 

E |(BB*),,(b*)S| 



h1 



+ _ ae/r2,p{i} 



E l(BB*)-| 



(32) 



Since by Theorem 13.51 Xr g = A+DB"*", then an entry of X^^ = (xjj) is (1271) . 
Denote by d.^ the sth column of A*D =: D = (Jy) G C"^^ for all s = T7g. 
It follows from E ^*kdks = d.^ that 



det (A* A) 



det (A* A) 



■d 



ks 



det (A*A) . [d 
det (A* A) 



fc=l k=l 

Substituting (1331) and (1321) in (127|) . and using (!29|) we have 



det (A* A 

E- 

s=l 



E i(BB*),.(b:.)2i 

*e/r2,p{i} 



det (A*A) 



E l(BB* 



(33) 
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g p n 

EEEdet(A*A),Je.O«, E l(BB*),.(e, 

S = lt=ll = l «G^r2,p{i} 

det(A*A) E l(BB*)2| 



p n 



EEdet(A*A)^(e.,) rf/i E l(BB*),,(e, 

t=ll = l oe/r2,p{j} 

det(A*A) E l(BB*)2| 



(34) 



If we integrate ( IHTj) in (Ell), then we get 



1=1 

Xi 



n 

Edet (A*A).,(e.O df 



det(A*A) E l(BB*)°|- 

aG/r2,p 

n 

Since again E ^./^h — then it follows ( I2T]) . where d^^ is ([19 
If we denote by 

n n 

^det(A*A)^ (d.,) = 5^det(A*A).,(e.,) d,. 



1=1 1=1 



the tth component of a row- vector d^ = (rf^, d^) for all t = l,p and 
substitute it in (IMj) . we obtain 

E4 E |(BB*),.(e,)Sl 



det(A*A) E l(BB*) 



p 

Since again E d^^t. = d^^, then it follows f l22|) . where d^ is (|T6|) . 
iiii) The proof is similar to the proof of iii). ■ 

4 An example 

In this section, we give an example to illustrate our results. Let us consider 
the matrix equation 

AXB = D, (35) 
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where 



A 



/I 


i i \ 


i 


-1 -1 





1 


V-1 


-I J 



B 



I 1 
-1 i 



D 



/I ^ 1\ 

z 1 

1 i 

VO 1 ^/ 



Since rank A = 2 and rank B = 1 , then we have the case (ii) of Theorem 13.61 
We shall find the least squares solution of by ( IT7|) . Then we have 



3 2i 3V 
A* A = \ -2i 3 2 I , BB* 

-3i 2 3 



3 -3i 
3i 3 



D = A*DB* 



1 -t' 
-i -1 
-i -1 



and E |(BB*)°| =3 + 3 = 6, 

oG/i, 2 



E I (A* A) 

/3eJ2,3 



det 



3 2i 
-2i 3 



By (]T5l) . we can get 

















1 











Since (A*A) ^ (d^J 



1 2i 3z' 

— z 3 2 I , then finally we obtain 
-z 2 3 



E (A*A) JdB)^ 



/9GJ2,3{i} 



E (A*A)^ E l(BB*) 

/3eJ2,3 06/1,2 



1.(1 2A , / 1 3z 
•^^^ ' _^ 3 / ~^ I -i 3 

72 



1 

'72' 



Similarly, 



72 ~ 72 ' 
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det 



3^22 = 



-2i 



72 

:n+detrj 3 



72 



72 

det ( _ 3i ll)+^"^(2 l| 
72 



2i 
72' 

2 

"72' 
i 

'72' 
1 

"72" 
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